A a rhv„< iqqq A 09/4 234 54 



jg^, ^ METHOD FOR ENCODING AND DECODING A DIGIT ALIZED IM AGE^ 

/ -WmmC TURE ELEMENTS * 

f\ . , In image compression methods for encoding or^ rccpoctivcly , decoding 

r* digrtalizedn mages, the images are usually divided into image segments. 

5 A distinction is made between two approaches for image encoding, object- 

based image encoding and block-based image encoding. Object-based methods for 
image encoding are described ^^J" An overview of block-based image encoding 
feb methods can be found ^[ 2] MPEG, [3] (I £25 3) and [4] (J PE6)r- 

Given block-based image encoding methods, the image is divided into 
1* 1 0 what are referred to as image blocks that usually comprise a rectangular shape and 

respectively comprise 8x8 or 16x16 picture elements. In the known methods, the 

:: =f: 

iU blocks are transformed with the assistance of a transformation encoding, preferably 

I H discrete cosign transformation (DCT), wavelet transformation or a transformation 

with vector quantization. 
l : * 1 5 Losses in the image quality must be accepted in the transmission of 

1:3 moving images over narrow-band channels such as, for example, 40 kbit/sec or lower 

%1 for picture telephony applications. The most noticeable disturbances are the 

u P brightness discontinuities known as block artifacts in block-based image encoding or^. 

ft . re s pectively -, as object edge artifacts in object-based image encoding, i.e. the abrupt 

2 0 changes of the values of the encoding information that is allocated to the individual 
fir picture elements produced by discontinuity points at the image block edges or, , 

ft - re s pectively , at the image object edges. 

What is to be understood below by encoding information is, for example, 
luminance information or chromance information that is respectively unambiguously 
2 5 allocated to the picture elements. 

Two different approaches are known in order to reduce the block artifacts. 
The first approach is based on corrections in the frequency domain of the 
spectral transformation. A method referred to as spatial shaping reduces the edge 
artifacts at the expense of the image quality in the interior of the block. This method 



^Q/fa) i s known from^5]7 Another method that is based on corrections in the frequency 

domain employs the prediction of the DCT coefficients. Although the quality in the 
j2 / j L6 ft* 5 interior of the block is improved by this procedure described in^6frthe block artifacts 
are only partially reduced. ^ 
5 The second approach for reducing block artifacts is based on corrections in 

^2/||L0 location domain.-^ discloses that the picture elements at the block edges be 

subjected to a low-pass filtering, as a result whereof the discontinuity points are 
JLv^d A ^ smoothed and appear less disturbing^fS^-discloses that different filters be employed 
for different image blocks, dependent, for example, on the quantization of the image 
block or, respectively, dependent on the motion vector. 

-f9^discloses a method for controlling various transmission parameters in 
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the framework of the H.263 standard, which is referred to as J.245 standard. It is 
known within the framework of the H.245 standard to inform a second arrangement 
with which communication is desired of specific transmission properties from a first 
15 arrangement via what is referred to as a capability table wherein the respective feature 
that is to be employed within the framework of the communication connection is 

indicated. &tl4fA1ft&y #F /A/\/£XfT?o flf 

Jbf/iQ jl^ Jh e inven t ion is ba^cd on the proble tt^ofcsp£ciiymg^ methods for encoding 

jT and for decoding a digimhgda image with which the required transmission capacity is 
2 0 reduced compared to known methods without the image quality being noticeably 
deteriorated. 

0*1 A J&J?* Tl i r prnfilrwn in rnlyr^ Vi y fan nWhH^ n n ™Hing tn pflt^nt rlflim 1 > ? j 1 

n ^Jli ivcn the method accoiding It) patent cMin 1; the digi t ali zo d - image, 

which comprises picture elements, is divided into a ^h^ali^ ^^ image segments. The 
2 5 division, i.e. the grouping, ensues such that at least one picture element is not 
allocated to an image segment for at least a part of the image between image 
segments. Only the picture elements that were allocated to an image segment are in 
fact encoded. 
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^- Givcn the mothod according to patent olaim 2 ; an encoded image having 
picture elements that are allocated to image segments are decoded in that the image 
segments are decoded and new picture elements corresponding to non-encoded picture 
elements of the encoded image are inserted between the decoded image segments. An 
5 interpolation is implemented between the image segments, as a result whereof 
encoding information is allocated to the new picture elements. 

. jG i rven the method aiiuidiug lu patent claim 3 " for encoding and decoding 
-fir of a^ dig^lizod -image, the picture elements are again grouped into ^^ui^ty o^ image 

segments. The grouping ensues such that at least one picture element is not allocated 
, 2 10 to an image segment for at least a part of the image between image segments. Only 
::r; the picture elements that were allocated to an image segment are encoded. The 

\m encoded image segments are transmitted and the image segments are decoded. New 

| : n picture elements corresponding to the non-encoded picture elements of the encoded 

image are inserted between the decoded image segments. A filtering is undertaken 
! " 15 between the image segments, as a result whereof encoding information is allocated to 

O the new picture elements. 

\ The invention can clearly be seen therein that the transmission of image 
u lines and image columns between image segments, for example between image blocks 

is foregone in the method The block grid upon employment of a block-based image 
2 0 encoding method is spread such that interspaces remain between the image blocks to 
be encoded, and the interspaces are interpolated after the decoding. 

As a result of this procedure, the required transmission capacity is reduced 
without the image quality in the interior of the image segment being noticeably 
deteriorated. Further, the block artifacts or, respectively^ the edge artifacts of the 
2 5 image objects are considerably reduced. 

fir 



Advantageous improvomontG of the invention derive from tho dependent, 



- claims. - « 

-ft is advantageous to apply a low-pass filtering to the image segments as 
-filtering; as a result whereof a good smoothing of the image segment edges is 



achieved. It is thereby advantageous for saving required calculating time to 
a implement the filtering essentially at the image segment edges. 

^ -ft-is also advantageous to implement a further filtering of the image to be 
encoded before the spreading and the encoding. The further filtering corresponds to a 
5 sub-sampling filtering as employed when sub-sampling images for improving the 

a image quality. . • 

-ft is also advantageous in a d o volopmcn t - to implement an interpolation 
filtering after the decoding, this taking effect essentially at the image segment edges. 
This corresponds to ajLOver-sampling filter, as utilized when enlarging images. 
1 0 ^-Themethod can be very simply implemented given block-based image 

encoding methods wherein the image segments are image blocks. At least 
respectively one picture element is not allocated to an image block between the image 
blocks. A very simple division of the picture elements into the image blocks is thus 
achievecf^^connected therewith, a very simple selection of picture elements not to 
15 be encoded is achieved. 
%2 order to further enhance the quality of the decoded image, it is 

~% advantageous to emplo,y_different filters for different image segments. 

u yC^ s thereby advantageous to select the filters dependent on the image 

quality of an image block, whereby the strength of the filter employed increases with 
2 0 the reduction of the image quality of the image block. 

j4t is also advantageous to select the different filters dependent on the 
motion vector of an image block, whereby the strength of the filter employed 
increases with the size of the motion vector that is allocated to the respective image 
block. 

2 5 The method is very well-suited for utilization for image encoding 

. according to the H.263 standard. i 

j-An advantageous possibility for integration of the method into the H.263 
standard is the employment of the capability table according to the H.245 standard, 
wherein the option for implementation of this method is entered as a separate 
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performance feature and becomes possible within the framework of the 
communication control that is implemented according to the H.245 standard. 
Tkc figuicu dcMiibc au e x e mplary embodiment of - the invention which is / 



^plained in greater detail below. 
Shown are: 

Figure l\(hrough If the principle of the method for a symbolically presented 

Hgitalized image having image blocks; 
Figure 2 an arrangement comprising a camera, two computer arrangements and two 

picture sbreens with which the method can be implemented; 
Figure 3 a block circuK^iagram with which the integration of the method into the 
+nolliod tieLOrdin^ to the H.263 standard is symbolically shown. 
Figure 2 shows a camera K that is connected to a first computer Rl via a 
connection V. The camera K supplies a sequence of^dt gifalized images B- that a r e 
supplied to the first computer Rl . The first computer Rl , just like a second computer 
R2 5 comprises a processor P as well as a memory S for storing the image data that are 
connected to one another via a bus BU. The first computer Rl and the second 
computer R2 are connected to one another via a line L. The first computer Rl and the 
second computer R2 are respectively connected to a first picture screen BS1 or, , 
roopcctivolyi, to a second picture screen BS2 for the presentation of the images B 
registered by camera K and potentially encoded and decoded. 

The camera K registers a scene and supplies it as a sequence of images B 
to the first computer Rl, and this is encoded in the first computer Rl according to the 
method for encoding that is set forth below. The encoded images CB are transmitted 
via the line L to the second computer R2 and are decoded in the second computer R2 
according to the method for decoding the encoded digital images CB that is set forth 
below. 

An image B is symbolically shown in Figure^kb- The image B in Figure 
la is subdivided into image blocks BB having respectively 8x8 picture elements BP. 
This is the standard procedure in block-based image encoding. 
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Figure^b-shows the image B with picture elements BP that are in turn 
grouped into image blocks BB each having respectively 8x8 picture elements BP. 
However, a respective interspace Z of at least one picture element BP is provided 
between the individual image blocks BB. The picture elements BP that are located in 
5 the interspace Z are not encoded, as explained below. 

This obviously means that the picture elements BP of the interspaces Z are 
simply "omitted" in the encoding. By deleting the picture elements BP of the 
interspace Z, a reduced image grid BR of the image B arises that only comprises 
PT picture elements BP that were allocated to the image blocks BB (see Figure 

. =; 10 Arrows P of Figure+b to Figure^-c symbolically show the imaging of the 

:;ri individual image blocks BB of the block grid with interspaces Z to the reduced image 

ly grid BR. 

i n The encoding is implemented for the reduced image grid BR, i.e. only for 

" the picture elements BP of the image blocks BB. This encoding ensues as 

\* 15 transformation encoding according to discrete cosign transformation (DCT). 

iff The method according to the H.263 standard is utilized as^encoding 

5 method. The encoded image data CB are transmitted to the second computer R2, 

™* received thereat and decode d* (Ste p 101; odtf Figure Id). 

A. 

After the decoding, potentially upon employment of inverse discrete 
2 0 cosign transformation according to the H.263 method, a decoded, reduced image grid 
-ri DBR derives that corresponds to the reduced image grid^Rfr(see Figur(^4e). 

The decoded, reduced image grid DBR is now expanded onto an expanded 
image grid EBR having the original size of the image B, in that the interspaces Z with 
the non-encoded picture elements are in turn filled between the image blocks BB (see 

/X- 

^ 2 5 Figured 

■A 

Image blocks BB that, due to the interspaces Z, lie at the image edge BRA 
and do not comprise 8x8 picture elements are processed by padding, i.e. filling up the 
image blocks BB with encoding information by extrapolation of the picture elements 
ft BP in fact present in the image block. The filling can ensue by allocation of the 
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fl encoding information of the picture elements that were previously not contained in the 

a. 

image block of the image edge BRA with a constant value. 

The relationships of the decoded image blocks BB in the decoded, reduced 
r block grid BR from Figure J-©- and the image blocks BB in 4-fufter insertion of the 

p 5 interspaces Z are shown by arrows P in Figure H-e and-4-fr- 

New picture elements are inserted into the decoded, reduced block grid 
DBR between the decoded image segments, i.e. the image blocks BB, being inserted 
in conformity with the non-encoded, i.e. "omitted" picture elements BP of the 
encoded image. 

= 3 10 In a last step, an interpolation filtering between the individual image 

iii blocks BB across the block edges and across the interspaces Z, i.e. over the picture 

^ elements of the interspaces Z, is implemented in the expanded image grid EBR. An 

I f- interpolation of the "missing" picture elements is thus achieved. 

A low-pass filtering at the block edges is implemented as filtering. A 
rX. 15 plurality of filters for different image blocks is selected according to the semantics of 

U the individual image blocks BB. The selection of the filters ensues (te^^^ent on the 

motion vector of an image block, whereby the strength of the low-pas^ employed 
increases with the size of the motion vector and/or dependent on the image quality of 
an image block, whereby the strength of the low-pass filter employed increases with 
2 0 the reduction in image quality of the image block BB. 

Vers i ons of the exemplary cmhoriTT Tre nt net forth nfawn nr o riinrlnr n rl h lpw 
It is not necessary to divide the image B into image blocks BB. It is 
likewise possible to utilize an object-based image encoding method within the scope 
* of the inventive method, whereby the picture elements are then grouped into a 

fi 2 5. plurality of image segments having an arbitrary shape. 

Further, any desired object-based ™\ r^p^rtiwiy i^wy-K^^ image 
encoding method, for example MPEG, JPEG, H.263 can be utilized, as can any 
desired transformation encoding, for example discrete sine transformation, a wavelet 
transformation or a transformation on the basis of vector quantization. 
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Figure 3 also symbolically shows a pos s ibility of how the method can be 
integrated into the existing H.263 standard. To this end, the mechanism of what is 
referred to as the capability table CT according to the H.245 standard is utilized (see 
Figure 3). A selection as to whether the standard H.263 method or the method for 
image encoding expanded by the inventive method should be employed can be made 
via a switch element SE. 

The expansion is symbolically shown by a block E in Figure 3 . When the 
expansion is selected, then a corresponding parameter is stored in the capability table 
CT in the first computer arrangement Rl, and is proposed in the framework of the 
setup of the communication connection to the second computer unit R2, which 
likewise comprises modules for the implementation of the H.245 standard and of the 
H.263 standard and of the expansion module E. 

After agreement about the image encoding method to be employed has 
been reached between the computer arrangements Rl, R2, either the method 
according to H.263 or the method expanded by the inventive method is employed. 

The invention can clearly be seen therein that the transmission of image 
lines and image columns between image segments, for example between image 
blocks, is foregone in the method. The block grid given employment of a block-based 
image encoding method is spread such that interspaces remain between the image 
blocks to be encoded and the interspaces are interpolated after the decoding. 
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